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ENTROPY OF CONVEX FUNCTIONS ON R d 


FUCHANG GAO AND JON A. WELLNER 


Abstract. Let D be a bounded closed convex set in R d with non-empty inte¬ 
rior, and let C r (H) be the class of convex functions on with L r -norm bounded 
by 1. We obtain sharp estimates of the e-entropy of C r (£l) under L P (Q) met¬ 
rics, 1 < p < r < oo. In particular, the results imply that the universal lower 
bound £~ d / 2 is attained by all d-polytopes. While a general convex body can 
be approximated by inscribed poly topes, the entropy rate does not carry over 
to the limiting body. For example, if is the closed unit ball in R d , then the 
metric entropy of Coo(f2) under the L p (fl) metrics has order e~( d ~ 1 )p/ 2 for 
p > ^“i • Our results have applications to questions concerning rates of con¬ 
vergence of nonparametric estimators of high-dimensional shape-constrained 
functions. 


1. Introduction 


Convex functions are of special importance not only because they are basic 
classes of functions, but also because they appear so commonly in applications. 
For instance, in nonparametric estimation of densities in statistics many interest¬ 
ing classes of densities are defined in terms of convex or concave functions on a 
bounded convex region. 

Let $2 be a compact convex set in WL d with non-empty interior. For 1 < r < oo, 


let 


C r (fi) 



/ is convex on $2, 


(jf o i/<.)r*r 



In this paper, we are interested in the covering number N(e,C r (£l), || • || p ) of C r (f2) 
under L P (Q) distances, where 1 < p < r, which is defined as the minimum number 
of closed balls of radius £ in L p (tt) distance that are needed to cover C r ( 12). When 
r = oo, for the purpose of statistical applications, we will also consider the brack¬ 
eting entropy number (e, Coo(fi), || • || p ) of Coo (ft) under L p (tt) distance, which 
is defined as the minimum number of £-brackets 


[/,/] := ReC^n) | l<g<f}, \\f-l\\ P <s 

needed to cover Coo(fi). It is easy to see that 

V(£,Coo(^), || • ||LP(fi)) < ^V[](2e,C 0O (n), || • HiP(fi)). 
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In the one dimensional case, a sharp estimate of logiV(e,Coo([0,1]), || • || 2 ) was 
obtained in [5] by connecting with the small ball probability of integrated Brownian 
motions. In fact, it was shown in [5] that for all bounded k monotone function 
classes _A4fc([0,1]) for all k > 1, we have 

logIV(e,7W fc ([0,1]), || • ||i 2 ( [0 ,i])) ~ 


where 

M k ([0,l]) = {f 


-1 < fix) < 1 , (-l)7 w (x) > 0,1 < i < k,x e [0,1] j . 


Note that since Coo([0,1]) C M 2 HO, 1]) — A^QO, 1]), the result above immediately 
implies that 

log7V(e,Coo([0,1]), || • || 2 ) x £~ 1/2 - 

A constructive proof with sharp estimate of iV[](e, Adfc([0,1]), || • || p ) for all k- 
monotone functions, k > 1 was given in [6]. The estimate of log IV(£, Coo([0,1]), || • || 2 ) 
was later rediscovered by [3]. 

In high dimensional case, if f 1 = [0, l] d , Guntuboyina and Sen proved that 

log7V( £ ,C7[0,l] d ),|Hlp)^- d/2 


for both r = 00 [9] and r > p [8]. Besides the hypercubes, there seem to be no 
other results available. 

While the set [0, l\ d maintains the simple geometric structure similar to that of 
[0,1], other shapes are much harder to deal with because their lack of nice geometric 
structure. Let us point out that for d > 2, even if LI is convex, the rate of metric 
entropy of C r (Ll ) could heavily depend on the shape of the convex body LI. For 
example, our Theorem 1.5 below says that when LI is the closed unit ball of R d , the 
entropy of Coo(Ll) has a growth rate far larger than e~ d ! 2 . 

In this paper, we study classes of convex functions on all compact convex sets f 1 
in R. d with non-empty interior. We first show that e~ d ^ 2 is the general lower bound, 
and if LI is a convex polytope, then e ~ d / 2 is also the upper bound. More precisely, 
we will prove the following theorem. 


Theorem 1.1. Let LI be a compact convex set in with non-empty interior. Let 
C r (Ll) be the set of convex functions on f 1 whose L r (Ll)-norms are bounded by 1. 

(i) There exists a constant C\ is a constant depending only on d such that for all 

e > 0 , 

logN(efi r (Q), || • HiP(n)) > c 1 \n\^~^£~ d/2 . 

(ii) IfLl can be triangulated into m simplices of dimension d, then any 1 < p < r, 
there exists a constant C 1 depending on p , d, r, such that for any £ > 0, 

logIV( £ ,C r (f2), || • ||i, ( n)) < C im \n\^-^ £ - d / 2 . 

Consequently, if LI is a convex polytope with v extreme points, then we can choose 
m = 0(^71). When r = 00 , the same inequality holds for bracketing entropy. 


In view of the fact that a general compact convex set can be approximated by 
convex sets with finitely many extreme points, one might guess that the rate £~ d ! 2 
holds for general compact convex sets in R d with non-empty interior. This, however, 
is not the case. This is because the upper bound increases linearly as m increases. 
This linear dependence on m is important. It enables us to establish upper bounds 
for general bounded convex sets. For that, we need the following definition. 
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Definition 1.2. Let fl be a bounded closed set in with non-empty interior. A 
sequence of d— simplices {D i, A ,...} is called an admissible simplicial approxima¬ 
tion sequence for 11 if A C fl for all i £ N and D° fl D° = 0 for all i 7 ^ j (where 
D° denotes the interior of D). Let T>q denote the collection of all admissible sim- 
plicial approximation sequences for 11. For an admissible approximation sequence 
{A} £ Vq and t £ ( 0 , 1 ) we define 

S(t, H; {Di}) = min{j £ N : |H \ Uj<j A| < 

and we call 

5(l,fl) = inf{5(l,H;{A}): {A} € X>n} 

the simplicial approximation number of H. 

Now we can state the following theorem. 

Theorem 1.3. Let fl be a compact convex set in with non-empty interior. Let 
C r {fl) be the set of convex functions on 11 whose L r (fl)-norms are bounded by 1 . 
Then, there exists a constant C depending only on d, p and r. such that for any 
0 < £ < 1 , 

tog jV(e|fi|M,C r (ll), || • \\lp(q)) < dt 

where 6(e) = and /3 = 2pr +f > f_ p)d - 

As an example, we consider the case when 11 is the closed unit ball in By 
specifically constructing a simplicial sphere approximation for the ball, we show that 
Theorem 1.3 implies the following corollary. Our proof of the corollary also provides 
a general scheme of constructing simplicial sphere approximations for uniformly 
smooth convex bodies. 

Corollary 1.4. If fl is the closed unit ball in then there exists a constant C 
depending only on p and d such that for all 0 < £ < 1 , 

! (d-l)p j 

Ce 2 ifP>i =I 

Ce~ d ^ \\oge\~^~ tfP =-jfzi ■ 

Ce~ d / 2 *fP<jh 

The following theorem implies the sharpness of Theorem 1.3: at least for the case 
when fl is the closed unit ball in R d , and p 7 ^ , the upper bound in Corollary 1.4 

is optimal, which in turn implies that the upper bound in Theorem 1.3 is optimal, 
and the dependence on m in Theorem 1.1 (ii) is optimal. 

Theorem 1.5. If fl is the closed unit ball in then there exists a constant c 2 
dependent only on d and p such that for all 0 < e < 1, 

togJVfoCootn), || • ||_LP(n)) > c 2 £~' 3 , 

where fl = max{(d— l)p/2,d/2}. 
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2. Proofs 

2.1. Scaling. In this subsection, we prove two lemmas, through which we can 
reduce a problem on an arbitrary closed convex set with non-empty interior to a 
problem on a closed convex set contained in [ 0 , l] d with volume at least 1 /d!. 

Lemma 2.1 (Boxing a Convex Set). Every compact convex set Cl in with a 
non-empty interior can be enclosed in a closed rectangular box of volume d!|f 2 |, and 
contains a convex polytope of at most 2d vertices and volume at least |f 2 |/d!, where 
|f2| stands for the Lebesgue measure of Cl. 

Proof. We use induction on d to show that we can find positive numbers hi, / 12 ,..., hd 
such that Cl is contained in a rectangular box of size hi x x • • • x hd, and contains 
a convex polytope of at most 2 d vertices with volume at least ^ ■ hi x /12 x • • • x hd- 
The statement is trivial if d = 1. Suppose the statement is true for d = k. 
Consider the case d = k + 1. Let hk+i = diam(fl). Choose x,y £ Cl so that 
||x — y || = hk+i- Let P/-(fi) be the projection of Cl onto the affine hyperplane 
that contains x and is orthogonal to x — y. Since Pf-(Cl) C is a fc-dimensional 
compact convex set with non-empty interior, by the induction hypothesis, we can 
find positive numbers hi, / 12 ,... ,hk such that Pf-(Cl) is contained in a rectangular 
box Rk of size hi x /12 x • • • x hd, and contains a convex polytope Tk of at most 2k 
vertices with volume at least k -hi x /i 2 x • • • x hk- If we let [x, y\ be the line segment 
between x and y, then Cl is clearly contained in the rectangular box Rk x [a;, y\ of 
size hi x /12 x • • • x hk+i- 

To show that Cl contains a convex polytope of at most 2{k + 1) vertices with 
volume at least T^p^yr • hi x /z 2 x • • • x hk+i, we let ui,U 2 , ■ ■ ■ u m , m < 2k, be the ver¬ 
tices of the convex polytope Tk. Clearly, the convex hull U of {x, y,ui,U 2 ,-.., u m } 
has volume \U\ > • hi x h 2 x • • • x hk+i- 

For each 1 < i < m, there exists Zi £ Cl such that P^Zi = Ui. Because Cl 
is convex, it contains the convex hull of {x, y, Zi, Z 2 , • • • ,z m j. Denote this convex 
hull by Tk+i- Then Tk+i has at most 2 (k + 1) vertices. Note that the volume 
of Tk- 1-1 is at least as large as \U\. Indeed, for any unit vector u perpendicular 
to x — y, consider the half-line in the direction of u starting from x. Suppose 
the half-line intersects the boundary U at w(u). Choose z(u) £ Tk+i such that 
Pf~z(u) = w(u). Clearly, the area of A xyz(u) is the same as that of A xyw{u), 
which equals ^hh+i\\x — 'Wj(ii)|| 2 - Let ak -1 be the (k — l)-dimensional spherical 
measure. By using a cylindrical system to compute the volume of Tk+i, we have 

|Ife+i| > / axea.(Axyz(u)) dok~i(u) = / axea(Axyw(u)) dak-i(u) = \U\. 

J s k ~ 1 J s k ~ 1 

Hence, |Tfc+i| > • hi x /i 2 x ■ ■ ■ x hk+i- This proves the case d = k + 1 , and 

thus the lemma. □ 

Lemma 2.2 (Scaling). Let Cl be a bounded closed convex set contained in a closed 
rectangular box R with volume |P| , and let T be any affine transform that maps R 
onto [0, l] d . Then for all 1 < p < r < 00 and e > 0, 

(2.1) N(e,C r (Cl), || • || L p (n) ) = M(|P| W e ,C r (T(H)), || . || iP(T(n)) ). 

Similarly, for all 1 < p < 00 and e > 0, 

(2.2) dV [] (^,C 00 (f2), || • || L p (n) ) = N^Rrh^iTiCl)), || • || L p (r(n) )). 
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Proof. Let / £ C r (T(f2)). Then |i?|" 1 / r / o T £ C r (f7) since 

[ \f\ r oTd\= [ \f\ r \T~ 1 \dX = \R\ f \f\ r d\<\R\. 

Jn Jt(q) Jt(q) 

Now let /i,..., /jv be an L p (Q) e-net for C r (f2). Then, for / £ C r (T( f2)) we have 

(f If-lR^fioT^^dx] 

f r \ 1 /p 

/ |/oT- |i?| 1/r /ir|T|dA) 

v-ln / 

^ lii?i i/r (| J R| _i/T '/°T-/ i ) n^r 1 ^ 

= \R\ 1/r - 1/p (Jj\R\- 1/r f oT - f^dx'j 

and since |i?| _1 / r /oT £ C r (ft), for some i £ {1,... ,1V} the last display is bounded 
above by |l?| 1 / r_1 / p e. Thus given an L p (Cl) e-net for C r (f2) we have constructed an 
L p (T( Q)) |l?| 1 / p-1 / r e-net for C r (T(f2)). It follows that 

(2.3) lV(|i?| 1 / r-1 / p e,C r (T(fl)), || • || Lp(r(n)) ) < N(e,C r {'SI), || • || M n)). 

By a similar argument we find that 

(2.4) lV(|l?| 1 / r_1 / p e,C r (T(n)), || • || Lp(T(n)) ) > N(e,C r (Sl), || • || M n)), 
and hence the equality (2.1) holds. 

To prove (2.2), first note that if / £ Coo(T(Sl)), then supn |/oT| = sup T (Q) |/| < 
1, so / o T £ C oo(fl). Then suppose that [/., /}], 1 < i < N, are L p (Sl) brackets of 
size e for Coo(Sl). Then [/. o T _1 , f i o T _1 ], 1 < i < N, are L p (T(Sl)) brackets of 
size |I?| _1 / p e for Coo(T(S})). To see this, note that for some i £ (1,..., N} 
l^x) < f o T(x) < Ji(x) for all x £ fi, 

and hence 

l o T~\y ) < f(y) < J z o T~\y) for all y £ T(Sl). 

Furthermore, 


lT( n) 


I fi o T-\y) - /. o T~\y)\*d\ = J\ f t - f.\*\T\dX 

\7i-Lf dX < {\ r \~ 1/Pe Y ■ 

J Q 


Thus 


!V [] (|I?|- 1 / p e ,C 00 (T(fI)), || • |U p(r(n) ) < N^CooiQ), || • || Lp( o)). 

A similar argument yields the reversed inequality, and hence (2.2) holds. 

By combining Lemma 2.1 and Lemma 2.2, we have 

(2.5) N(e,C r (Sl), || • ||lp(q)) < JV((d!)M . |fl|M e ,C r (T(fi)), || • || £ p (T(n ))), 
and 

(2.6) N^C^Q), || • |Up ( nj) < N u ((d!)"? • |fi|H^,^(7(0)), || • |U*( T (n))), 


□ 
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where T(ll) has volume at least 1 /d\ and is contained in [0, l] d . 

2.2. Under Uniform Lipschitz. In this subsection, we recall that if we assume 
the functions in C r (£l) are bounded and uniform Lipschitz, then the metric entropy 
estimate would follow from the following known results of Bronshtein [1]. 

Lemma 2.3 (Bronshtein). Let K.{p ) be the set of all closed convex sets contained 
in the closed Euclidean ball of radius p in R d+1 , d > 1. Let h be the Hausdorff 
distance on K,(p). There exists a constant Cq depending only on d, such that for 
any 0 < e < p, 

log N{e,IC(p),h) < C 0 {p£~ 1 ) d/2 . 

Lemma 2.4. Let Q be a closed convex set in [0,1] , and let .F a (12) be the class of 
convex functions on f l that are bounded by M and have Lipschitz constant bounded 
by a. Then for all e < 2 -1-1 / p y / (l + a 2 )(M 2 + d/4), 

logTV^^fl), || • |U P (fi)) < 2- d U 0 {(l + o 2 )(4M 2 + d)} d ^e~ d / 2 

where Cq is the same constant as in Lemma 2.3. 

Remark 2.5. Lemma 2.3 can be found in [1], [4], or [14] Lemma 2.7.8, page 163. 
Lemma 2.4 is also known. For example, it would follow from [14] Corollary 2.7.10, 
page 164. Because we deal with bracketing entropy, we include a proof here for the 
convenience of the reader. 

Proof. For each / £ T ai since 11 is a closed and convex set and / is convex, 
the epigraph epi(/) = {(a;, f) : f(x) < t < M, x £ 11} is a closed convex set 
contained in the closed Euclidean ball in R d+1 with radius yJd/A + M 2 and center 
at (1/2,1/2 ,..., 1/2,0). 

On the other hand, for any re £ 11, z/ £ 11, and f,g€ E a , 

1/0*0 - g(x)\ < | f{x) - f(y )| + | f{y) - g{x)\ 

< a\\x- y\\ 2 + \f(y)-g(x)\ 

< Vl + a 2 \\ (x,g{x)) - {y,f(y))h- 

Taking the inhmum on y £ 11 followed by the supremum on i £ 11, we find that 
||/-fllloo < \J\ + a 2 /i(epi(/),epi(s)). 

Thus, by Lemma 2.3 

logIV ( 77 , Coo(H), || • |Uoo (n) ) < log JV((1 + a 2 )~ 1 / 2 r ? ,/C(v , M2 + d/4), h ) 

< C 0 {^(1 + a 2 )(M 2 + d/^r,- 1 }^ 2 . 

Thus there exist N < exp(C 0 { yj (1 + a 2 )(M 2 + d/4)r]~ 1 } d ^ 2 ) functions / 1 ,..., /at 
defined on H, such that for each / £ /C(H), there exists some /), *£{1,2,..., TV}, 
such that | f(x) — fi(x)\ < 77 for all x £ H. For each i £ {1,..., TV} define 

7iO) = sup{/(x) : | f(x) - fi{x) | < T), f G 
l.(x) = inf {/(a;) : \f(x) - f t {x) \ <*?,/£ T a } 
for each x £ H. Then we have 

II Si ~ /JIe°“(0) < 2?7. 
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In particular this implies that for all 1 < p < oo 

[ \7i{x) ~ f {x)\ p dx < (2r]) p . 

Jsi ~ l 

Letting e = 2r/ we find that 

logiV[](e,C 00 (fI), || • || L p ( n)) < loglV(2?7,C 00 (fl) J || • ||oo) 

< CoW( 1 + « 2 )(M 2 + d/4)(2r/)~ 1 j d ^ 2 
= 2~ d C 0 {(l + a 2 )(4M 2 + d)} d/4 £~ d/2 . 

□ 


2.3. Paring the Boundary. In this subsection, we show that if we pare off the 
boundary of 12 by 6, and consider the set 

(2.7) 12,5 = {x G 12 | dist(x, cA2) > (5} , 

then considering functions restricted to Lis-, the entropy can be estimated using 
Lemma 2.4. The details are proved in the following two lemmas. 

Lemma 2.6. Let LI be a compact convex set in [0, l] d with |I2| > 1/d!. Then there 
exists a constant A depending only on d, such that for any 1 < r < oo and any 
0 < 5 < 1 , 

C r (Ll) c A 5 ~ d / r ■ Comfit), 

where 12 s is as defined in (2.7). In fact A = max{(dr(d/2)/7r d / 2 ) 1 / r , (d!)d2 d+2 } 
works. 


Proof. First, we show that if / G C r (f2), then on Ll 
( 2 . 8 ) / > —(d!) 1 / r 2 d+ 2 d. 

Let Xq be a minimizer of / on 12. If f(x o) > 0, then there is nothing to prove; 
otherwise, the set K := {x G 12 | f(x) < 0} is a closed convex set with Xq as an 
interior point. Denote Kq = K — Xq, and define 

K v = fin{x 0 + [(1 + v)K 0 \ (1 - rj)K Q }}, 

where 0 < g < 1. We show that if x ^ K v , then |/(x)| > r]\f(xo)\. Indeed, consider 
a function g on f2 defined so that: g(x o) = f{x o), g( 7 ) = /(y) for all 7 G dK, and 
g is linear on line segment 

L 7 := {x G f2 | x — Xq + tfi) — xo ), t > 0} . 

Then, by the convexity of / on each L 7 , we have |/(x)| > \g{x)\ on 12. Because for 
all x K v , ||cc — y|| > 77 ||xo — 7 ||, we have 

IffWI = IflMI + > v\f( x o)\- 

Hence, on 12 \ K v , \f(x)\ > 7 ?|/(x 0 )|. 

Because the volume of K v is bounded by [(1 + rj) d — (1 — rf) d ] ■ \K\ < d2 d r]\Ll\, 
we have 

1 > [ \f(x)\ r dx>( V \f(x 0 )\y-[l-d2 d r 1 ]-\n\. 

Jn\K„ 


\f(xo)\<V~ 1 \n\- 1/r (l-d2 d r 1 )}- 1 / r . 


This implies that 
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By choosing rj = [ d2 d (l + 1 /r)\ 1 , we obtain 

|/(cc 0 )| < M~ 1/r d2 d fl + ^-\(l + r ) 1/r < (d\) 1/r 2 d+2 d < {d\)2 d+2 d. 


This proves (2.8). 

Next, we show that there exists a constant C depending on LI such that on Llg, 
f(x ) < A 5~ d / r . 

Let zq be a maximizer of / on Llg. If f(zo) < 0, there is nothing to prove. So, 
we assume /(zo) > 0. Let V = {x £ | /( x) < /(z 0 )}- Then V is a convex set 
with zo at its boundary. There exists a hyperplane that separates V and zq- This 
hyperplane separates If into two parts. On the part not containing V, f > /(zo). 
In particular, / > /(zo) on the half of the ball centered at z 0 with radius S. Calling 
this half of the ball W, we have 


i >/j/MM* > ^ 


S d f(zoY 


which implies that 




- V 7r d /2 ) 

Together with (2.8) we obtain that there exists some A depending only on d such 
that for all x G fta, \f(x)\ < A5~ d ^ r . □ 


Lemma 2.7. Let Q be a closed convex set in [0, l] d . For any 1 < r < oo and any 
0 < 5 < 1, 

JV [] (e,C r (n), || • || lp ( q 5 )) < exp(c 2 6- d / 2 - d2 / r e~ d / 2 ), 

where f lg is as defined in (2.7) and C 2 is a constant depending only on d, Co in 
Lemma 2.3, and A in Lemma 2.6. 


Proof. We show that when restricted to fig, f has a Lipschitz constant bounded 
by 2 2+d / r A5~ 1 ~ d ^ r . Indeed, by Lemma 2.6, / is bounded by 2 d l r A5~ d / r on ^ 5 / 2 - 
Note that f lg C flg/ 2 C LI. Thus by [14], problem 2.7.4 page 165, / is Lipschitz on 
O 5 with Lipschitz constant 2(5/2)~ 1 2 d / r AS~ d ^ r = 2 2+d / r A6~ 1 ~ d / r . 

Thus by Lemma 2.4 it follows that 

logfV [] (e,C r (Q), || • ||iP(n i5 )) 

< 2~ d C 0 {l + 2 A+2d/r A 2 5~ 2 ~ 2d/r ) d/i {AA 2 5~ 2dlr + d) d/4 e~ d/2 

(2.9) < C 2 S- d/2 - d2/r e~ dl2 

for some constant C 2 depending only on d and r. □ 


2.4. Combining. In this subsection, we prove some lemmas that enables us to 
studying metric entropy by decomposing the set LI. 

Lemma 2.8 (Union). If LI = ujL x Lli, then for all 1 < p < r < 00 , 

k 

(2.10) N(e,C r (Ll ), || • || LP(n) ) < J[N (rn,Cr{^i), II ■ ||ip(no) » 

i— 1 

k 

-/V[](e,Coo (LI), || • ||LP(n)) < Y\. N U i r l^ c oo(^i), II • l|iJ>(ni)), 

i =1 


( 2 . 11 ) 
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where e = ( 72i=i Furthermore, if f2i, Q 2 ,..., ttk have disjoint interiors, 

then 

k 

( 2 . 12 ) N(e,C r (n), || • || L p (n) ) < 4 * If ^ fo.W), || • \\ LP{at) ) 

i =1 


where 


r — p 



Proof. For each i £ {1, 2,..., k}, there exists a set Mi of N-, elements, where 

Ni = N(rji,C r (Qi), || • || L P(o i )) 

such that, for each / £ C r (fi) C C r (fli), there exists fi £ Mi satisfying 

[ \fi{x) - f(x)\ p dx <r%. 

Jiii 

Define /( x) = fi(x) for x £ Dj \ 1 < i < k. Then we have 

P k p k 

/ \f(x)-f{x)\ p dx<J2 \f(x)~ fi{x)\ p dx <^2 ^ = e p . 


i=l 


2 — 1 


Because there are no more than N 1 N 2 ■ ■ ■ Nk realizations of /, (2.10) follows. 

The proof of (2.11) is similar. For each i £ {1, 2,..., k}, there exists a set Mi of 
Ni brackets, where 

= A^[](ryi,Coo(Dj), || • ||iP(n 4 )) 

such that, for each / £ C oa (fl) C C oc (Q i ), there exists a bracket [/.,/J £ Mi 
satisfying / (a;) < f(x) < fj(x) for all a; £ f2*, and 

/ 17*0*0 - < 77?. 

•In* _l 

Define /(x) = /,(x), /(x) = /.(x), x £ Dj \ Uj<jf2j, 1 < i < k. Then we have 
/(x) < /(x) < /(x) for all x £ D, and 

k k 

\7(x)-l(x)\ p dx < £ / I7i(*) -/ i (*)l p d® <J2v!=e p . 

2 = 1 ^ 2=1 



That is, [/, /] is an e-bracket in L P (Q) which contains /. Because there are no more 
than N 1 N 2 ■ ■ ■ Nk realizations of [/,/], (2.11) follows. 

Now we turn to the proof of (2.12). For any / £ C r (fl), and for each i = 
1, 2,..., k, define m(f) as the smallest positive integer such that 

ni(f) >kf \f(x)\ r dx. 

J( 2i 

Then, rii(f) < k / n . \f(x)\ r dx + 1, and using the fact that 72i=i In- I f\ r dx < 1, we 
get 
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Let 

X = {(m,ri 2 ,..., nfc) e N fe | ni + n 2 H-1 -nk < 2fc} . 

For each I = (U, j 2 ,..., ik) £ I, define 

J 7 / = {/ € C r (n) | rij(f) = ij, l< j <k} . 

Then we have C r (12) = U/gzd 7 /. Thus, 

N(e,C r (fl), || • HiP(n)) < ^-/V(e, J 7 /, || • ||,LP(n))- 
/ex 

Note that for each j = 1, 2,..., k, J 7 / C ( ij/k) 1 t r C r (yij ). Thus, 

NfaCr&i), II • llx^)) = [ii/k^CriSU), II • || L p (n ,)) 

> JV((t j /fe) 1/ ^,J>,||-|| i , (nj )). 

Therefore, for each 1 < j < k, there exists a set JVj of Zj := N(r]j,C r (Cli), || • ||lp(o 3 )) 
elements such that for each / £ J 7 /, there exists fj £ Afj satisfying 

/ I/O) - /jO)Px < ( ij/k)' p/r rf j . 

JQi 


If we define f(x) = fj{x) for x £ flj \ U r< jCl r , then we have 


I/O) - f(x)\ p dx < '^2(ij/k) p/r ri: 

3=1 


OeO e 


Vi 


^ E 


Vi 


< £ P . 


u =1 


u ' =1 


U =1 


Since, there are no more than ZiZ 2 • • • realizations of /, we obtain 

k 

(j)ii C r (£li), || • HiPfOi)) ■ 


Note that I has cardinality ( 2 fc fe ) < 4 fc , and hence (2.12) follows. 


□ 


2.5. With Finitely Many Facets. Note that by the well-known Upper Bound 
Theorem of discrete geometry [11], [7], if 12 is a convex polytope with v vertices, 
then it has at most k < 2(,/ 2 j) < 2x; L d / 2 J facets. In this subsection, we consider 
the case when 12 is a convex polytope with k facets. We first prove the upper bound 
with constant Ck 7 with some 7 > 1. We will use it later only for the case k = d- 1-1. 
However, since the proof is the same, we prove it for the general k. 

By scaling, we can assume that f2 is contained in unit d-cube with volume at 
least 1/dl. Thus, there exists a point O £ 12 such that the distance between O and 
the boundary of f2 is at least do := l/(2dd!). This is because the boundary of [0, l\ d 
has (d — l)-dimensional area 2 d, and its projection onto f 2 is a contraction, thus, the 
boundary of 12 has (d — l)-dimensional area at most 2d, and by a Bonnesen-style 
inequality (Corollary 2, page 25 of [12]) the inradius of 12 is at least its volume 
divided by the (d — l)-dimensional surface area of its boundary, i.e. the inradius is 
at least do. 

By otherwise using a translation, we can assume that O is the origin. Let Fi be 
the *-th facet of 12 for i = 1 ,k. Let Vi denote the convex hull of Fi and O. Then, 
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Vi, i £ {1,..., k}, form a partition of H. For S < So = 2 cPd\’ ^ ^ 0 := (1 ~ 5/8q)H. 
Define Hi = V. \ Dq, where Dq denotes the interior of Dq. Then we have 

h = d 0 u Di u n 2 u • • • u n k . 


Note that each Hi has no more than k + 1 facets. To see this, we first observe Vi 
has at most k facets. Indeed, each of the facets of Vi besides Fi is the convex hull of 
a (d — 2)-dimensional face of Fi and O. However, each (d — 2)-dimensional face of 
Fi corresponds to the intersection of Fj and another facet of H. Thus, the number 
of (d— 2)-dimensional faces of Fi is at most k— 1. Therefore, the number of facets 
of V. is at most k. Notice that Hi has one more facet than V. Hence, the number 
of facets of Hi is at most k + 1. By (2.12) we have 

(2.13) 

k 

N(e,C r (H), -IliPfn)) < 4 k+1 N(r/ 0 ,C r (D 0 ), || • IU*(d 0 )) J^-W(j?i,C r (fii), II • ||z,p(n 4 ))> 

2 = 1 


where r] 0 = 2 pe, and 


rii = 2 p 


|^2 


1_1 


Because D$ C H$, by Lemma 2.7, we have 

logJV( e ,C r (n), II • II L P (Do) ) < c 2 s-i-^(e)- d / 2 . 


On the other hand, if we let T,; be an affine transform that maps Hi into [0, l] d so 
that the volume of Tj(flj) is at least 1/d!, then by scaling (2.5), and using the fact 
that 

k 

Y 1^1 = P \ (! - V«o)n| = [1 - (1 - <V<5 0 ) d ]M < d6/6o , 

1=1 

we have for each 1 < i < 


N(rji,Cr{Hi), || • ||z,P(n 4 )) < N(Ke,Cr(Ti(Hi)), || • ||iP(T i (n i ))), 

where 

K = 2~ 1 /P[2d 2 {d\) 2 6]r-p. 

Plugging into (2.13), we obtain 

log!V(e,C r (fi), || • HiP(n)) <(k + 1) log4 + C 2 S~^~^ e~ d/2 

k 

(2-14) +Y^gN(Ks,Cr(Ti(Hi)),\\ • || inTi(Qi) )). 

i =1 

Now let Fj- consist of all closed convex sets in [0, l] d with at most k faces and with 
volume at least 1/d!, and define 

9{k,e) = sup {log AT(e,C r (n), || • || L p(n)) | ^ e F k } . 

d d 2 

For notational simplicity, we denote M = C 2 S~^~~. Then (2.14) together with 
the fact that [k + 1) log 4 < 4fc — 4 which follows from the fact that k > 3) implies 

(2.15) g(k, e) + 4 < Me~ d/2 + k[g{k + 1, Ke) + 4], 
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which is equivalent to 


[ 9 (k,e) + 4\e d ' 2 < M + j^\g(k + 1 ,Ke) + 4}{Ke) d ' 2 . 


Now, we choose 5 so that K d / 2 = 2k. Then 



Thus, 


[g(k,e) + 4}e d t 2 < C 3 fc ( r ~p P + ^[ g{k + 1, (2 k) 2 ^ d e) + 4]((2 k) 2 ^ d e) d ^ 2 . 


( r+2d)p 


Hence, for any positive integer to, we have 


[g{k,e) +4}e d/2 < C 3 ^ ^ - + 2 m [g(k + m, L m e) + 4](L m e) d/2 , 



L m =l | ( 2 k + 2 jf/ d . 


In particular, if we choose m to be the smallest integer so that L m e > 1, then 
g(k + m, L m £) = 0, and we obtain 



This finishes the proof of the upper bound with constant of the order k 7 with 

= (r+2 d)p D 

' r—p 

2.6. Upper Bound for Polytopes. Note that if is a convex polytope with 
v extreme points, then it has no more than 2 i;L d / 2 J facets; see [10], Propositions 
5.5.2 and 5.5.3, page 100. Therefore, we immediately obtain the upper bound with 
constant of the order ip L d / 2 1 . We show that this estimate can be improved to 
v \ d /2 \. Indeed, if has v vertices, then it is known that can be triangulated into 
to = many d-simplices; this is Corollary 2.3 of [13]; see also [2]. Thus, 

we can write H = U^A, where A are d-simplices. Because each A has only 
(d + l)-facets, by what we have proved above it follows that 


logJV(r/i,C r (A), II • IUha)) < C 5 |A|*-^C d/2 


where C 5 is a constant depending only on p, r, d. Now applying (2.12), with 



we immediately obtain 


m 


logiV(£r,C r (H), || • lliP(fi)) < ^logA%,C r (A),|| • ||l*-(d 4 )) 


< C 6 TO|H|^ _ ^e " d/2 < cW d/2 ' ] £- dl2 . 


This proves Part (ii) of Theorem 1.1. 
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2.7. General Upper Bound. Fix 0 < e < 1; we choose smallest integer s so that 
2 _s |12| < [2 -1 / p e] 7:= p|f2|. By the definition of 5(2,12), 12 contains mi < 5(1/2,12) 
d-simplices Du, 1 < i < mi, so that the volume of 12 \ U ™^iDn is at most 2 _1 |12|, 
and the set 12 \ UU^-Di^ contains m 2 < 5(1/4,12) d-simplices D 2 ,j, 1 < j < m 2 , so 
that the volume of 



is at most 2~ 2 |12|. Continuing this way, we obtain a sequence of d-simplices Dj j , 1 < 
j < mi,l < i < s that are packed in 12 so that the uncovered volume of 12 is at 
most 2 _s |12|. If we denote 



then for all / £ C r (12) 



Hence, 


(2.16) JV( e |12|W,C r (fi), || • || L p (n) ) < 2V(2- 1 / p £ |12|?-UC r (12 s ), || • || iP(0s) ). 


Next, we choose 



where 


a i = (2 _i |12|) 1_/3 [5(2 _i , 12)]^, /3 = — 

2 V 

Using the fact that Wi,j\ — 2 _ ^ _1 ^|12|, we have 


2 pr 


2 pr + [r — p)d 



Thus, together with the fact that ra; < 5(2 *, 12), we have 


^ ' log C r (Djj), || • II LP(D iij )) 



-d/2 



Therefore, by (2.12) and (2.16) we have, 


logiV(e|12|p -,C r (12), || • || LP(n) ) 
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Let 7 = rp/(r—p). Note that 2 s < [2 1 / p e ] 7 <2 ( s 1 \ and 5(2, f2) > 5(2 l , 12) 
for 2 e [2"( i+1 ), 2-*]. Thus it follows that 


i=l 


E a * = E( 2 “*M) 

i— 1 

= 2|sip-«;r ' 2 
2=1 


5(2" 1 , 12) 
2 ~ i 


dt 


i=1 ' 

r>2~ 


f s(t, 12) 


dt 




dt 

< 2|12I 1_/3 r 


dt. 


Hence, 

c 2^+5| 


(j>*) - [e|12|i--]- rf/2 < c2*+£+7 ^ ^ 


/ 5(2,12) 


i//S 


dt 


. F - d /2 


where <5(e) = 2 2 • [2 1 /,p e] 7 . 
Similarly, 


E 5 ( 2 "‘, 12)<2 


2=1 


r 1 S(t,n) 

2- 2 .[2- 1 /p £ ]7 2 


dt. 


Hence, we obtain 


log-/V(e|12|p r ,C r (12), || • ||lp ( o)) 
C 


with (7 = max 


|21og4 


*}■ 


c 2 2 ~ l " 2 p " 


2.8. Upper Bound for the Ball. As a specific example, we consider the case 
when 12 is the closed unit ball in R d . We claim that there exists a simplicial approx¬ 
imation sequence {D±, Z? 2 ,...} so that the corresponding simplicial approximation 
number 5(2,12) = 0 ( 2 _ t j - ). 

Denote Id = [—1, l] d D 12. For any integer k with 2 2 ~ k \fd < 1, each facet of Id 
can be divided into 2 k( ~ d ~ 1 ' > closed (d — l)-cubes of side-length 2 l ~ k . Each of the 
these small (d — l)-cubes can be triangulated into no more than d! closed (d — 1)- 
simplices. Thus, the boundary of Id can be triangulated into m*, < 2 k( ' d ~ l ' l+l dd\ 
closed (d — l)-simplices, each of which has edge-length at most 2 Y ~ k \fd. Let Aj, 
1 < i < rrik be these simplices. For each 1 < i < nrik , by connecting the origin with 
the d vertices of Aj, we obtain d line segments. These d line segments intersect 
the boundary of 12 at d points. Denote the convex hull of these d points by A, . 
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Thus Aj is a (d — l)-simplex with edge-length less than 2 1 k \fd. Let P k be the 
convex hull of A,, 1 < i < m k • Then P k is a simplicial sphere contained in 12 with 
rrifc < 2 k ( d ~ 1 ' )+1 dd\ facets. For each x £ fl\ Pk, we show that ||x|| > Vl — 2 2 ~ 2k d. 
Indeed, if we connect x and the origin, then the line segment from 0 to x intersects 
some facet Aj of Pk, say at y. If ||z|| < \/l — 2 2 ~ 2k d, then ||y|| < \/l — 2 2 ~ 2fc d. Let 
C(y) be the spherical cap with a base disk centered at y. Then C(y) has base radius 
larger than 2 1 ~ k \fd. Because all the vertices of Aj are within 2 1 ~ k y/d distance from 
y, these vertices all belong to the cap C(y) above the base hyperplane. This is not 
possible because y belongs to the convex hull of these vertices. Therefore, for each 
x £ 12 \ Pk, ||x|| > Vl — 2 2 ~ 2k d. Consequently, the volume of 12 \ Pk is at most 
[1 - (1 - 2 2_2fc d) d / 2 ]|12| « 2 1_2fc d 2 |12|. 

Now, let k\ be the smallest positive integer k such that [1 — (1 — 2 2_2fe d) d / 2 ] < 1/2. 
Recall that the simplicial sphere P kl constructed above has si := m kl facets, each of 
which is a (d — l)-simplex. Let D\, D 2 ,. ■ ■, D Sl be the convex hull of each facet with 
the origin. Then D\, D 2 ,. .., D Sl is a triangulation of P Sl . We define S(t, 12) = Si 
for \ <t< 1. 

Suppose we have defined for 2~ r < t < 1, and the non-overlapping 

simplices D 1 , Di, D Sr with the property 

U£ X A = P kr 

where k r is a positive integer k r so that the volume of \ P kr is at most 2 -r |fi|. 
We choose k r+ 1 to be the smallest positive integer so that the volume of 12 \ Pk r+1 
is at most 2 -r-1 |f2|. Thus, k r+ \ > k r . Note that the simplicial sphere Pk r+1 
constructed above has no more than q := m kr+1 facets, each of which is a (d — 1)- 
simplex. Let Si, S 2 ■ ■ ■ S q be the convex hull of the origin with each of these facets. 
Then Si, S 2 , ■ ■ ■, S q is a triangulation of P kr+1 • Note that each Sj intersects with 
no more than d\ facets of P kr ■ Indeed, each Si is contained in the convex hull of 
the origin and a (d— 1) cube of side-length 2 1 ~( fer+1 ) that lies on a facet of [—1,1] d , 
which is further contained in the convex hull of the origin and a (d — l)cube of 
side-length 2 1 ~^ fcr ) on a facet of [—1, \] d . However, the latter convex hull intersects 
with no more than d\ facets of P kr . Thus, there exists a constant c(d) depending 
only on d such that Si \ P kr can be triangulated into c{d) d-simplices. Therefore, 
Pfc r+ 1 \ P kr can be triangulated into c(d)q d-simplices. We define these simplices 
as D Sr+ 1 , D Sr+ 2 , • • • , D Sr+1 , where s r +i = s r + c(d)q, and define S(t, 12) = s r+ i for 
2~ r ~ 1 <t< 2~ r 

Next, we show that for this sequence of simplices, 5(2,12) = 0(t~~2~). Indeed, 
since for each 2 = 1,2,..., fcj is the smallest integer k satisfying [1— (1 — 2 2-2fc d) d / 2 ] < 
2~ l , we have 2~ 2ki ~ 2~ l ~ 1 /d 2 . Also note that m ki < 2 ki ( d ~ 1 ^ +1 dd\, which implies 
that rn ki < kd 2*( d_1 )/ 2 for some constant kd depending only on d. Consequently, 
for any 2 _r_1 <t< 2~ r , by the construction above 

r+1 

S{t, 12) = m kl + c(d)m k2 -I- \- c(d)m kr+1 < c(d) ^ m ki 

i— 1 

r+1 

< c(d)k d J2^ id ~ 1)/2 < k' d t- {d - 1)/2 , 

2=1 

for some constant k' d depending only on d. 
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A direct computation of the integrals in Theorem 1.3 gives an upper bound of 
e s -2 when p > I logel -2- when d = and e ~ d / 2 (from the second 

integral term) when p < • This implies the estimate in the corollary. 


2.9. General Lower Bound. By Lemma 2.1 and Lemma 2.2, we only need prove 
it for the case when 52 is contained in [0, l] d and has volume at least 1/d!. Indeed, 
by Lemma 2.1, if 52 C is closed and convex, 52 C R for a box R with \R\ < d!|52|. 
Let T be any affine transformation that maps R onto [0, l] d , Then by Lemma 2.2, 
and the fact that G r (T(52)) D C' 00 (T(52)), we have 

iV(|52|We,C r (52), || • || iP(n) ) = JV((|52|/|i2|)*-* e,C r (T( 52)), || • || iP(T(n) )) 

> N(e 1 C oa (T(fl)), || • ||_lp(t(0)))- 


Thus it suffices to establish a lower bound for the case when 52 is contained in [0,1]“ 
and has volume at least 1 /d!. 

We choose a function / so that / is supported on [0, l] d , with 0 < / < Aj and 
||y||i > Furthermore, the Hessian matrix of / at every (xi,x 2 , ■ ■ ■ ,x d ) £ [0, l] rf 
is a diagonal matrix with each entry bounded by 1. One such function is 


f(x i,x 2 , ...,x d ) 


SnaE^iSin 3 ^) if (xi,x 2 ,...,Xd) £ [0, l] d 

0 if (x\,x 2 , ■ ■ ■ ,Xd) [0, l] d 


For each fixed 0 < e < (lOd!) 2 , and each I = (ii, i 2 , ..., id) £ N d , define 


fi(xi,x 2 ,... ,x d ) = e 2 • / 




Then, // is supported on 



Bi ■■= [he, (h + l)e] x [i 2 e, ( i 2 + l)e] x • • • x [i d e, (id + l)e] 

with 0 < fi < |p, H/jHi > ^ • e d , and furthermore, the Hessian matrix of fj at 
every (x±,x 2 , ..., Xd) £ Bj is a diagonal matrix with each entry bounded by 1. 
Denote 

l={i\l = (h,h,...,i d )eN d ,B I cn}. 

Let £/ £ {0,1}, I £ I be i.i.d. random variables with P(£j = 1) = P(£j = 0) = 1/2, 
and define the random function 


F(x;£) = ^2tifi(x). 

/ei 


Then for each realization of / = (£/)/ez, we have 0 < F < and the Hessian ma¬ 
trix of F is diagonal with each entry bounded by 1. Therefore, for each realization 
of £ the function 

G(x; 0 = ^ ( x i + x \ + ’ • • + x d ~ F (x\ £)) 

is convex and bounded by 1. Hence, G(-;£) £ Coo([0, l] d ). 

There are 2^ realizations of G(-;£). Between two realizations, we define the 
Hamming distance 


H(G(-;£ ( 1 ) ),G(-;£ (2) )) =#{/£! 
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For r = L|X|/10J, consider the set 

U(G(-,£),r) = {g(-;£ ( 2) ) : J?(G(-; £), G(-; £< 2 >)) < r} . 

For each G(-;£), the set /7(G(-;£),r) contains no more than 

t (?) s 28111/10 

k =0 V ' 

elements. Thus, by the pigeonhole principle, we can find m > 2 ] ' I ^2^ I ^ W = 2 1 1 !/ 10 
realizations of G(-; 1 < k < m, such that for any 1 < i < j < to, we have 


Note that 


[ G(z;£ w ) - G(x;£ w ) dx =^~ I ^|Cj } ~^i 3) \\fi{x)\d- 
Jn a Jn 7i -t 


iex 

W 


>i Vlf (i) -£ U) \ _e“ 

-dZ^^ 1 4 1 1 80 d 

/ei 

Z d -mn* Jw ' 8 


(2.17) 


We show that the cardinality |I| of I is at least ^e . Indeed, because f1 C [0,1]“ 
has volume at least 1/d!, and is convex, so the set [0, has volume at most 

1— l/d! + 2d-Vde. Thus, [0, l] d \^^ E contains no more than e~ d - [1 — l/d\ + 2d-y/de\ 
cubes Bj. Any cube Bi C [0, l] d that is not contained in [0, l] d \ does not 
intersect with [0, l]\f2, thus must be contained in fl. Since [0, l] d contains [ 1 /erJ d 
such cubes, and we conclude that contains at least 


1 — 1/d! + 2d ■ Vde 


Li/ e j^ £ 

cubes provided that e is small, say e < (10d!) -2 

l 

2d! 


- 2d! £ 


Now plugging the inequality |X| > ^e d into (2.17), we obtain 


[ G0r;£«)-G(z;£«) 
Jn 


dx > ce , 


for some constant c depending only on d. This implies that Coo([0, l] d ) contains 


TO 


> 2I 1 '/ 10 > e c 


functions whose mutual L 1 ( fl) distance is at least ce 2 . This implies that 
loglV(e,C oo ([0,l] d ),||-|U 1 (n))>c"e- d / 2 
for some c" > 0 depending only on d. 

Since |fi| > A, for any p > 1, we have || • ||lp(o) > (d!)~~|| • || L 2 (n) , this implies 
that 

log IV(e, Coo([0, l] d ), || • HiP(fi)) > ce~ d/2 

for some constant c depending on p and d, provided that |f2| > A. 

Together with the discussion at the beginning of this subsection, and the fact 
that bracketing entropy is bounded below by metric entropy we conclude that the 
lower bound statements of Theorem 1.1 are true. 
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2.10. Lower Bound for the Ball. The (d— l)-dimensional area of the unit sphere 
in R 6 * is 2Tr d / 2 /T(d/2), while the ( d — l)-dimensional area of a cap with height h is 
(n d / 2 /r(d/2))I 2 h-h 2 ((d — l)/2,1/2) ~ Cdfi ( d_1 )/ 2 where I x {a,b) is the regularized 
incomplete beta function. Thus there exist s = adh~^ d ~ 1 ^ 2 disjoint spherical caps 
with height h. The d— dimensional volume of each spherical cap is I3dh ^ d+l ^ 2 . Let 
Xi,... ,x s be the spherical center of the caps. For each 1 < i < s, we define a 
random function /* on the closed unit ball such that 


My) 


0 , 

t (y t xj)-(l-h) 
^ h > 


(y,Xi) < l -h, 

(y, Xi) > l -h, 


where tf is either 0 or 1. Now /, is convex on the closed unit ball, and supported 
on the *—th cap. Furthermore, since the caps are disjoint, the sum / = fi 
is also convex and bounded by 1. There are 2 s different realizations of /. By the 
same argument as we used in the proof of the lower bound of Theorem 1.1, we can 
find a set W of 2 s ! 2 functions in which any two functions / and g are different on 
at least s/10 caps. 

On each cap where the two functions are defined differently, \f — g\ > 1/2 the 
top half height of the cap which has a volume 7 dh^ d+1 ^ 2 . Consequently the L p 
distance between any two functions /, g € W is at least 

i(s/10- 7d h( d+1 )/ 2 ) 1 /P>^/ l 1 / p . 

Letting 8dh 1 / p = e we have 

NfaCaoiD), II • |Up W ) > exp (Ce-V-W 2 ) . 


When (d — l)p < d, the lower bound above should be replaced by the universal 
lower bound e~ d / 2 proved in the last section. 
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